# Large model inference optimization

An image-text to text conversion model built on the Meta Llama base model, supporting interaction through gguf-connector and llama-cpp-python.

An ultra-low-bit (1-2 bit) quantized model based on Llama-3.1-70B, utilizing IQ-DynamicGate technology for adaptive precision quantization, enhancing accuracy while maintaining memory efficiency.

Qwerky-QwQ-32B is a large language model with 32B parameters, specializing in text generation tasks.

Sky-T1-32B-Preview is a 32B-parameter large language model, quantized using llama.cpp's imatrix, suitable for text generation tasks.

Quantized version of Mixtral-8x22B-v0.1, using llama.cpp for quantization, supporting multiple languages and quantization types.